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Method of moving a device provided with a camera to a desired position by means of a 
control system, and such a system 



The invention relates to a method of moving a device provided with a camera 
to a desired position by means of a control system, wherein the camera is coupled to the 
control system. 

The invention further relates to a system comprisfaig a device provided with a 
5 camera, which device can be moved to a desired position by means of a control system, 
wherein the camera is coupled to the control system. 



In such a metiiod, which is known from United States patent US-A-5,880,849, 

10 and in such a system, the device is a componmt placement machine provided with a nozzle 
by means of which components are picked up fit)m a component feeder, after which the 
device is moved to a position above a substrate on which the component is subsequently 
positioned. The device is provided with a camera by means of which a smgle picture of the 
component relative to the nozzle is produced as well as a single picture of a part of the 

15 substrate. The part of the substrate of which an picture is produced is provided with a 
marking element Information regarding the desired position of the component on the 
substrate relative to the marking element is stored in a control system coupled to the device. 
On the basis of the pictures produced by means of the camera, a desired control of the device 
is detennined in the control system, such that the component is positioned in the desired 

20 position on the substrate. 

A drawback of such a method resides in that the desu^d position of the 
component relative to the marking element on the substrate is stored in the control system, 
which desked position is based on a theoretical model of tiie substrate to be provided with 
components. If, due to manufiEicturing inaccuracies, the actual, desired position on the 

25 substrate is not accurately situated with respect to the maiking element, then the component 
will be theoretically placed in the correct position, however, in actual fact it will not be 
positioned correctiy on, for example, electroconductive tracks present on the substrate. 
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Also if previously an picture is produced of the actual location where the 
component is to be placed, there is still the risk that during moving the component to said 
desired position, said desired position wiU have slightly changed, as a result of, for example, 
vibrations of the device, the device being subject to shocks, and other external factors, as a 
5 result of which the component will still be incorrectly positioned on the substrate. 



It is an object of the present invention to provide a method by means of which 
a device can be accurately moved to a desired position. 

10 This object is achieved in the method in accordance with the invention, in that 

during moving said device, pictures of the desired position are taken by means of the camera, 
the number of pictures processed per tune unit by means of the control system being 
increased as the distance between the device and the desired position is smaller. 

In this manner, during moving the device a number of pictures are taken of the 

IS actual, desired position. If the distance between the device and the desired position is 

comparatively large, the number of pictures taken per time unit and/or processed per time 
unit may be comparatively small because the movement accuracy during the movement over 
a comparatively large distance may be comparatively inaccurate. However, as the device is 
situated closer to the desired position on the substrate, the movement of the device must be 

20 more accurately determined in order to eventually accurately reach the desired position. 

Therefore, as the distance becomes smaller, the number of pictures processed 
per time unit by means of the control system is increased in order to be able to determine the 
movement of the device to the desked position more accurately by means of the control 
system. 

25 An embodiment of the method according to the invention is characterized in 

that as the distance between the device and the desired position is smaller, an area situated 
around the desired position is reduced in a picture which is analyzed by means of tiie control 
system. 

If the distance between the device and tiie desired position is comparatively 
30 large, an picture must be produced of a comparatively large region around the desired 
position in order to ensure that tiie desired position is present in tiie picture. At a 
comparatively large distance from the desired position, the accuracy with which the desired 
position can be determined in the picture is less relevant However, as soon the device has 
been moved to a position closer to the desired position, it is important that an accurate picture 
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of the desired position and the surrounding area is produced. This area may be comparatively 
small, however, as a result of which the speed with which the picture can be analyzed in the 
control system is comparatively high. As, in addition, at a comparatively small distance from 
the desired position the number of pictures processed per time unit by means of the control 

5 system is increased, a reduction of the area to be analyzed is important also to enable the 

pictures in the control system to be analyzed comparatively rapidly. The distance between the 
device and the desired position can be physically determined. Since the device is moved in 
the direction of the desired position, it is also possible to assume, after a certain period of 
time has elapsed, that the distance has been reduced, at which moment the area to be 

10 analyzed is subsequently reduced. 

An embodiment of the method in accordance with the invention is further 
characterized in that the number of pictures processed per time unit by means of the control 
system is mcieased step by step. 

By stepwise increasing the number of pictures processed per time imit by 

1 5 means of the control system, for example when a predetermined distance to the desired 
position has been reached, the desired accuracy during moving the device to the desired 
position can be readily achieved. 

A still further embocBment of the method in accordance with the invention is 
characterized in that by means of the control system, a movement of the device observed by 

20 means of a sensor is combined with information from the pictures produced by means of the 
camera. 

In this manner, direct feedback of the movement of the device observed by 
means of the sensor as well as of the uiformation regarding the position of the device relative 
to the desired position obtained from the pictures produced by means of a camera takes place 

25 in the control system. Rf^id and accurate feedback is thus ensured particularly in tiie vicinity 
of the desired position. Besides, as long as the desired position is not yet observable by 
means of the camera, the device can be moved by means of the sensor. 

Hie invention also relates to providing a system by means of which a device 
can be accurately moved to a desired position. 

30 In the syst^ in accordance with the mvention, this object is achieved in that 

the control system comprises means for determining a distance between the device and the 
desired position, as well as means for increasing the number of pictures to be processed per 
time unit. 
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Using the means for increasing the number of pictures to be processed per 
time imit, it is possible to increase the number of pictures to be processed per time unit at a 
comparatively short distance between the device and the desired position, so that near the 
desired position more pictures are processed, enabling the device to be more accurately 
5 controlled to the desired position. 



These and other aspects of the invention are apparent from and will be 
elucidated with reference to the embodiment(s) described hereinafter. 
10 In tiie drawings: 

Fig. 1 is a perspective view of a ^stem m accordance with the invention. 
Figs, 2-4 are control schemes of a control system of the system in accordance 
with the invention as shown in Fig. 1. 

15 

Fig. 1 shows a system 1 in accordance with the invention, which is provided 
witii a frame 2, transport rails 3 supported by said frame 2, and a movable device 4 situated 
above the transport rails 3, which displaceable device is coimected with a camera 5 and a 
nozzle 6. The device 4 can be moved in directions indicated by means of arrows X, Y as well 

20 as in opposite directions, using means known per se. The nozzle 6 is further movable in a 

direction indicated by means of arrow Z, as well as in the opposite direction. The system 1 is 
providied with a control system 7 which is electrically cormected with the camera 5 as well as 
with drive means for moving the device 4 in the directions indicated by means of arrows X, 
Y. Said drive means for the device 4 preferably comprise servomotors provided with 

25 encoders which serve as a sensor for determining the position in, respectively, the X and the 
Y direction of the device 4. The encoders are electrically connected with the control system 
7. 

By means of said transport rails 3, a substrate 8 is moved in the direction 
indicated by means of arrow X to a position near that of the device 4. On the substrate 8 there 
30 are provided a number of reference elements 9 as well as a number of positions 10 on which 
components are to be positioned. Next to the transport rails 3 a number of component feeders 
(not shown) are arranged from which a component can be individually picked up by means 
of the nozzle 6, which component must subsequently be positioned in a desired position on 
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the substrate 8. The system described hitherto is known per se and latgely corresponds to the 
system as described in US-A-5,880,849. 

Fig. 2 shows a first embodiment of a control scheme 20 provided in the control 
system 7. As the camera 5 is connected with the device, the position of the device 4 can be 
5 derived. The desired position 10 on the substrate 8 is recorded in a picture by means of the 
camera 5. The picture and the position of the device are supplied to an image processing 
device 22. On the basis of the picture thus processed, a planner 23 is used to determine a 
route to be covered by the device 4 and the component supported thereby, in order to be able 
to position the component in the correct position 10 on the substrate 8. In the planner 23, also 

10 referred to as trqectory generator, an optimimi time is calculated for the distance to be 

bridged by the device, consideration being taken of, inter alia, the maximum speeds of the 
sensor motors. The processing frequency of such a planner is comparatively low and the 
number of pictures to be processed may thus also be small. From the device 4, the positions 
in the X and Y direction of the device 4 as determined by the encoder 21 are supplied to a 

1 S comparator 24 in which the difference between the position of the device 4 determined from 
the picture relative to the desired position 10 and tiie position of the device 4 determined on 
file basis of the encoders 21 is compared. The difference is supplied to a controUer 25 with 
which the movement to be carried out by the device 4 is determined. 

Fig. 3 shows a different control scheme 30 of the control system 7 in 

20 accordance with the invention. Said control scheme 30 differs fi-om the control scheme 
shown in Fig. 2 in that the planner 23 is replaced by a comparator 3 1 and a unit 26. In the 
comparator 31, the relative position, determined fit)m a picture, between the device 4 and the 
desired position 10 is compared with a reference value. This reference value indicates a 
desired shift of the desired position observed fi-om the picture, and the actual position on 

25 which the component must be placed. It is possible, for example, to position the component 
in a slightly rotated position with respect to a track pattern present on the substrate. It is also 
possible to omit the comparator 3 1 . The difference is supplied to a unit 26 wherein a path to 
be followed by the device 4 is calculated. The size of the area to be analyzed situated around 
the desired position 10, which area is processed by means of the image processor 22, can be 

30 optically reduced for the purpose of accurately moving the device 4. The area to be analyzed 
around the desired position 10 is reduced, both in terms of software and optically, as the 
distance between the device 4 and the desired position 10 becomes smaller. The calculations 
by the unit 26 are less complex than tiiose of the planner 23. In the controller 26, preferably 
only the difference between the actual position and the desired position of the device is 
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compared, as a result of which calculations can be carried out and pictures can be analyzed at 
a higher frequency, thereby enabling the device 4 to be accurately moved to the desired 
position. By virtue thereof, it becomes possible for the control scheme 30 to process pictures 
at a higher speed than the control scheme 20. 

5 Fig. 4 shows a third embodiirient of a control scheme 40 of the control system 

7 of a system 1 in accordance with the invention. The picture obtained by means of the 
camera 5 is analyzed in an image processor 41; preferably only specific, clearly recognizable 
aspects of the desired position 10 which are visible on the picture are analyzed, thus enabling 
the position of the device 4 relative to the desired position 10 to be determined comparatively 

10 rapidly from the picture. The actual position of the device 4 is also determined by means of 
the encoders 21 . The positions determined by means of the encoders 21 and the image 
processor 41 are supplied to a filter, for example an extended Kalman filter, wherein the 
actual position of the device 4 is accurately determined. If the encoders operate at a higher 
fi:equency than the camera 5, it is possible to obtain information by means of the encoders 21 

IS which is more accurate than the information obtained from pictures produced by means of the 
camera 5. By combining the use of encoders and pictures obtained by means of the camera S, 
more accurate and more rapid positioning of tiie device 4 on the desired position 10 can be 
achieved. The value originating from the filter 27 is supplied to a comparator 42, where the 
calculated, actual position is compared with the reference value. Otherwise the control 

20 scheme 40 corresponds to the control scheme 30. 

The operation of the system 1 is as follows. 

First, the device 4 is moved, by means of the control system 7, to a component 
feeder where a component is picked up by means of the nozzle 6. When picking up a 
component use may be made of the camera 5 to increase the pick-up accuracy. In addition, by 

25 means of the camera 5 tiie position of the component held by the nozzle 6 relative to the 

device 4 can be determined. On the basis of the information regarding the relative position of 
the substrate 8 with respect to the transport rails 6, which information is stored in the control 
system, as well as on the basis of the position of tiie device 4 determined by means of the 
encoder, the device 4 can be moved in the direction of the desired position 10. 

30 As soon as the desired position 10 is detected by means of the camera S, 

pictures of the substrate 8 and of the desired position 10 thereon are processed in the control 
system 7 at a comparatively low frequency o^ for example, 25 Hz. These pictures are 
processed by means of tiie control scheme 20. 
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At this stage, the device 4 is to be moved close to the desired position 10 as 
rapidly as possible, which operation does not have to meet high accuracy requirements. 

As soon as the distance between the device 4 and the desired position 10 fells 
below a specific threshold value, the number of pictures processed per time unit by means of 
5 the control system 7 is increased to, for example, 500 Hz. In addition, in the control system 7 
switching from control scheme 20 to control scheme 30 or 40 takes place. In order to be able 
to rapidly process all pictures generated by means of this frequency, the area around the 
desired position 10 which is considered in the image processor is reduced and, preferably, 
only relevant aspects of the desired position, such as a specific element of a track pattern, are 
10 analyzed. 

If necessary, different control schemes 20, 30, 40 may be acconmiodated in 
tiie control system 7, and, dependent upon the distance between the device 4 and the desired 
position 10, first the control scheme 20 and subsequently a control scheme 30 or 40 are 
applied. Alternatively, first control scheme 20 and subsequently control scheme 30 followed 
15 by control scheme 40 may be applied, the number of pictures to be processed per time unit 
being increased between each switching operation fit>m control scheme 20 to control scheme 
30 or 40. 

It is also possible that the picture produced by the camera shows both the 
device and the desired positioa From such a picture the distance between the device and the 
20 desired position can be directly derived. This is more accurate than the situation where the 
position of the device must be derived. 



